torch
auto-gptq
transformers
sentencepiece
protobuf
optimum